Papers by Bruce W Lee
Instruction Tuning with Human Curriculum (2024.findings-naacl)
Copied to clipboard
| Challenge: | a recent study shows that human curriculum-inspired strategies can enhance performance of large language models. |
| Approach: | They propose a method for generating instruction-response datasets that emulate human learning . they find that substantial improvements can be achieved through curriculum ordering . |
| Outcome: | The proposed method achieves performance improvements on truthfulQA, MMLU, OpenbookQA, and ARC-hard benchmarks without additional computational costs. |